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We study the dynamics of a version of the batch minority 
game, with random external information and with different 
types of inhomogeneous decision noise (additive and multi- 
plicative) , using generating functional techniques k la De Do- 
minicis. The control parameters in this model are the ratio 
a = p/N of the number p of possible values for the exter- 
nal information over the number N of trading agents, and 
the statistical properties of the agents' decision noise param- 
eters. The presence of decision noise is found to have the gen- 
eral effect of damping macroscopic oscillations, which explains 
why in certain parameter regions it can effectively reduce the 
market volatility, as observed in earlier studies. In the limit 
N — > oo we (i) solve the first few time steps of the dynamics 
(for any a), (ii) calculate the location a c of the phase tran- 
sition (signaling the onset of anomalous response), and (iii) 
solve the statics for a > a c . We find that a c is not sensitive 
to additive decision noise, but we arrive at non-trivial phase 
diagrams in the case of multiplicative noise. Our theoretical 
results find excellent confirmation in numerical simulations. 

PACS numbers: 02.50.Le,87.23.Ge,05.70.Ln,64.60.Ht 



I. INTRODUCTION 

One of the more recent application domains of equi- 
librium and non-equilibrium statistical mechanics is the 
analysis of simplified models describing large markets of 
competing traders (or agents). One such model, which 
in spite of its apparent simplicity was found to exhibit 
highly non-trivial behaviour and has therefore attracted 
much attention, is the so-called Minority Game (MG) 
|, which is a variation on the so-called El-Farol bar 
problem || which mimics in a highly idealized fashion 
a market of speculators attempting to profit by buying 
when most others wish to sell or selling when others wish 
to buy, without individual knowledge of their fellows but 
only of their collective consequences and external infor- 
mation available to all. An extensive overview of the 
literature on the MG and its many variations and exten- 
sions can be found in Q . The striking feature of the MG, 
clearly observed in numerical simulations, is the nontriv- 
ial dependence of the market volatility (measuring global 
fluctuations) on the dimensionality of the information 
supplied to the agents (which is defined as the relative 
number a of different values which the information can 
take). For large a the volatility approaches the value 
corresponding to random trading, and the system is er- 



godic. As a is reduced, also the volatility is found to 
decrease beneath random, which is indicative of a more 
efficient market, where agents have 'learned' to improve 
the effectiveness of their selection of trading strategies. A 
further decrease of a will at some critical point a c force 
the system to undergo a phase transition to a highly non- 
ergodic regime, where both a high-volatility state and a 
low-volatility state can emerge, dependent on initial con- 
ditions (this was only appreciated later). 

In the original minority game, the information supplied 
to the agents consisted of the actual history of the mar- 
ket. However, it was soon realized [|| that the dynamics 
of the MG remains largely unaltered if, instead of the true 
history of the market, random information is supplied to 
the agents; given a, the only relevant condition is that 
all agents must be given the same information (whether 
sensible or otherwise). This led to a considerable sim- 
plification of theoretical approaches to the MG, since it 
reduced the process to a Markovian one. A further gen- 
eralization of the game was the introduction of agents' 
decision noise Q, which was shown not only to improve 
worse than random behaviour but also, more surprisingly, 
to be able to make it better than random. The study 
was followed by a number of papers aiming to develop 
a solvable statistical mechanical theory, either by using 
decision noise to 'regularize' the stochastic equations and 
replace these by deterministic ones (followed by an equi- 
librium analysis of the ergodic regime, built on the con- 
struction and exploitation of a Lyapunov function) , 
or by concentrating further on analysis of the stochastic 
equations themselves || . Since the MG process does not 
obey detailed balance, such studies (which also involved 
different implementations of the decision noise), proved 
to be hard, and their results partly controversial pO 11 
(especially with regard to the questions of whether and 
when the stochastic MG equations can be replaced by 
suitable deterministic ones). 

More recently, in |L2| the analysis of the MG was ap- 
proached from a different angle: all problems and debates 
regarding microscopic determinism were simply avoided 
by re-defining the MG dynamics directly in the form of 
discrete-time deterministic equations, without decision 
noise (the so-called 'Batch Minority Game'). This al- 
lowed for an exact solution of the model using generating 
functional techniques a la De Dominicis ]l3[ ], which was 
found to be in excellent agreement with numerical simu- 
lations, and which (due to it being dynamical in nature) 
even applied to the non-ergodic regime. The present 
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study, which can be regarded as a natural follow-up on 
achieves the following objectives. We generalize 
the 'Thermal Minority Game' such as to allow different 
agents to have different levels of decision noise. This in- 
troduces inhomogeneity into the agent population, which 
leads to interesting new phenomena and phase diagrams. 
We generalize and apply the (exact) formalism of Jl^] 
(which was developed for the deterministic MG) to the 
case of having inhomogeneous decision noise, within the 
context of the discrete-time deterministic ('batch') equa- 
tions. All our theoretical results are shown to find excel- 
lent confirmation in extensive numerical simulations. 



II. MODEL DEFINITIONS 

The minority game involves N agents, labeled with 
Roman indices k, etc. At each round £ of the game, 
all agents act on the basis of the same piece of exter- 
nal information !{€)■ In the original model |JjJ the his- 
tory of the actual market was used as the information 
given to the agents. In view of the observation in || 
that random information is equally efficacious we here 
consider that at each round £ the agents are given the in- 
formation I(£) — L«, where for each £ the label /i(£) 
is chosen randomly and independently from p = aN 
possible values, i.e. fx{£) G {I , . . . , aN}. To determine 
how to convert the external information into a trading 
decision, each agent i has at his/her disposal S strate- 
gies R ia = (Rl, Rf a N ) e {-1, l} QAr ; a e {I, . . . , S}. 
Each component Rf a is selected randomly and indepen- 
dently from {—1, 1} before the start of the game, with 
uniform probabilities, and remains fixed throughout the 
game. The strategies introduce quenched disorder into 
the model. Each strategy Ri a of every agent i is given 
an initial valuation or point-score Pi a (0), In the deter- 
ministic version of the game, given a choice fi(£) made 
for the information presented at round £, every agent i 
selects the strategy which for trader i has the highest 
valuation at that point in time, i.e. the strategy with 
label a,i{£) = arg max Pi a {£), and subsequently makes 
a binary bid &,-(£) = R%~%y The (re-scaled) total bid 

at stage I is defined as A(£) = iV~ 1/2 MO- Each 
agent subsequently updates the pay-off values of each of 
his/her strategies a on the basis of comparing the bid 
which would have resulted from playing that strategy 
with the actual outcome: 



P ia (£+l)=Pia(£)-R^ ) A(e) 



(1) 



The minus sign in this expression ensures that strate- 
gies that would have produced a minority decision are 
rewarded. Since the qualitative behaviour of the market 
fluctuations was found to be very much the same for all 
non-extensive numbers of strategies per agent larger than 
one ||, we restrict our discussion to the 5 = 2 model, 
where the equations can be simplified upon introducing 
for each agent the instantaneous difference between the 



two strategy valuations, qi(£) — [pn(£) — Pi2(£)]/2, as 
well as the average strategy u>j = (Rn + Ra)/2 and 
the difference between the strategies = {Rn — Ri-i)j1. 
The actually selected strategy in round £ can now be 
written explicitly as a function of a binary variable 
Si{£) = ±1, which in the original model takes the value 
s.i{£) = sga[qi(£)], viz. R t a z (e) = w» + «i and the 

evolution of the difference will now be given by: 



q t (£+l) = qi(£) 
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C^iWL (2) 



with n = n- 1 ' 2 J2j <*>j e tr° 

In the so-called thermal minority game [||, the deter- 
ministic decision rule s -(£) = sgn[qj(£)] was replaced by 
a stochastic recipe; another recipe was employed in 
Here we generalise this idea further, by allowing different 
traders to have different levels of stochasticity in their 
decision making. We will consider decision noise of the 
general form 



,(£)=a[q j (£),z J (£)\T J ], 



(3) 



in which the Zj (£) are independent and zero-average ran- 
dom numbers, described by some symmetric distribu- 
tion P{z) which is normalised according to J dz P(z) = 
fdz P(z)z 2 = 1. The function a[q,z\T] £ {-1,1} is 
chosen to interpolate smoothly via a single control pa- 
rameter T between a[q, z\0] = sgn[g] for T = and 
a[q, z\oo] = ±1 (randomly, with equal probabilities) for 
T = oo, so that T provides a measure of the degree of 
stochasticity in the traders' decision making (with ran- 
dom choice in the case q = 0). Typical examples are 
additive and multiplicative noise definitions such as 

additive : a[q, z\T] = sgn[g + Tz] (4) 

multiplicative : a[q, z\T] = sgn[q] sgn[l + Tz]. (5) 

In the first case (^) the noise has the potential to be 
overruled by the so-called 'frozen' agents ||, who have 
qi(t) ~ fat for t — > oo pp|-p^]. In the second case the de- 
cision noise will even retain its effect for 'frozen' agents 
(if they exist). The above definitions represent situations 
where for Tj > a trader i need not always use his/her 
'best' strategy; for Tj — > we revert back to the deter- 
ministic model. The impact of the multiplicative noise 
(o) can be characterised by the monotonic function 



A(T) = Jdz P[z) sgn[l + Tz], 



(6) 



with A(0) = 1 and A(oo) = 0. For example, for a Gaus- 
sian P(z) one has A(T) = erf[l/V2T]. 

Finally in the formulation of the model, we replace 
the above 'on-line' version of the microscopic dynamics 
(||), following |l^| , by a so-called 'batch' version, where, 
rather than modifying the {qi} after every observation 
of an individual piece of external information, they are 
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modified according to the average effect of the possible 
choices for the external information: 

a (i+ 1) = Qi w - lit $ + tt^ E zfa w] . ( 7 ) 



A»=l 



giving 



q t (t + 1) = - ftj - J] J y - <r[<fc(t), «i(t)|T 3 -], (8) 



where Jy = 2N~ 1 ^ i ■ £j and hi = 2N~i£i ■ SI. The spe- 
cific choice of time scaling in (g) has been made for later 
convenience. The batch dynamics (||) has the advantage 
of being sufficiently simple and transparent to allow for 
a straightforward exact dynamical solution of the model, 
using generating functional techniques . The process 
(||) is not exactly equivalent to (||), not even for N — > oo 
(see [E3 for the generating functional analysis of the on- 
line dynamics and its relation to the batch alternative), 
but it does present qualitatively similar features. 

There are many ways to introduce a stochastic element 
into the traders' decision making. For instance, the two 
versions of the minority game studied in |(^|| correspond 
to the forms (g) and (§) with P(z) = \K\{ - tanh 2 (ifz)] 
and Tj = T for all i (giving strategy selection probabil- 
ities of the form Prob(er = ±1) ~ e ±l3q and Prob(cr = 
±1) - e ±/3s S n W, respectively). 

The magnitude of the market fluctuations, or volatility, 
is given by 



CT 2 = <-£(^) 2 ) z -<i]>>^ 



(9) 



where = J^ii^i + s *£f] an d where (. . .) z denotes 
an average over the random numbers {zt}. One easily 
derives 

^E^>* = -^E<^E^+ (^)> 



p 



aNVN 

^E(^)% = ^ + ^Em*>*4e^ 



(Si)z 



-0(N~2). 



(11) 



Purely random trading corresponds to (^^2 /J ,A) z = 
and a 2 = 1. Following [Q we also define the volatility 
matrix H«': 



(12) 

which measures the temporal correlations of the market 
fluctuations. Note that c 2 = S tt . In the case where the 
average bid (A) is zero (as in the present model), the 
volatility measures the efficiency of the market. 



III. GENERATING FUNCTIONAL ANALYSIS 

The canonical tool to deal with the dynamics of the 
present problem is generating functional analysis a la De 
Dominicis |l3f| , which allows one to carry out the disorder 
average (here: the average over all strategies) and take 
the N — > oo limit exactly. The final result of the analy- 
sis is a set of closed equations, which can be interpreted 
as describing the dynamics of an effective 'single agent' 
1 , . Due to the disorder in the process, this single 
agent will acquire an effective 'memory', i.e. he/she will 
evolve according to a non-trivial non-Markovian stochas- 
tic process. Here we will follow closely the steps taken in 
[jl2|| , and we refer to the latter paper for full details of the 
calculation. In contrast to the situation in p2[ ), for the 
present noisy version of the game one finds a microscopic 
transition probability density operator W{q\q'): 



W(q\q') 



dq 



(27T) 



(eEiiUn-ti+hi+Ei J v»j)) z , (13) 



with the short-hand s'j — cr[q'j, Zj\Tj]. The moment gen- 
erating functional for a stochastic process of the present 
type is defined as 

Zty] = ( e'EtE* **{*)«(*) j 

II [*!(*) W(q(t+l)\q(t))} p (q(Q)) 



x e 



''E t Ei^(*)9*W 



(14) 



Derivation of the generating functional with respect to 
the conjugate variables i/> generates all moments of q at 
arbitrary times. Upon introducing the two short-hands: 



■4 Saw 



^kystm, (15) 



as well as Dq = Y[ u [dq^t) / \/^k\, Dw = U^t[ dw t /V2vr] 
and Dx = Ylut[d x t /"v^l (with similar definitions for 
Dq, Dw and Dx, respectively), the generating functional 
takes the following form: 

ZW\ = J DwDwDxDx e iEUW+^<W2<(^+<)] 

=^ E „« &t E t [<S> (t)+2? (*)] \ 



X JDqDq po(g(0)) (e 

x e <E«[?i(*)(9i(*+i)-<K(*)-e<W)+*<W?i(*)l 



(16) 



where, as in we introduced external 'forces' 9i(t) to 
generate response functions. 

To describe typical behaviour, and in view of the self- 
averaging character of the large N limit, at this stage 
we average over over the explicit choices of the quenched 
random parameters {R}. These averages are not affected 
in any way by the introduction of the noise variables 
{zi} or the independent temperatures Ti, and the fur- 
ther procedure of still applies here, generating the 
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dynamical order parameters C t t> — N 1 £V Si(t)si(t'), 
K tt , = N- 1 J2 i s l (t)q l (t'), and L tt , = N-^&WW) 
and their conjugates. For times which do not scale 
with N and for simple initial conditions of the form 
Po(q) = T\iPo(qi) one thus finds: 



3 AT[*+$+f2] +O(iV ) 



Z[ip]= / [DC DC] [DKDK] [DLDL] 



(17) 

The O(N ) term in the exponent is independent of the 
fields {ipi(t}} and {0i(t)}. The three relevant exponents 
in Jj"7j ) are given by the following expressions: 



* = iJ2[Ctt'Ctt> + K tt ' Kw + L w Ltt' 



w 

$ = a In 



DwDwDxDx e ^ t [^t+x tXt +w tXt \ 

x e -kT.tt'[ w t w t>+™tL tt ,w t ,+2xtK tt ,w t ,+x t C tt ,x t ,] 



(18) 



(19) 



DqDq po(?(0)) 



x e *E t [?(t)[9(t+i)-«(i)-ei(*)]+'/'i(t)9(*)]-'>E tt ' q(t)L ttl q(t') 
x ^ e - i E tt '[ ;i i(*) ( 5 tt 'Si(t')+si(t)-R" tt /9(t')]^ _ (20) 

Here Sj(i) = cr[g(t), Zt\Ti\ and the average (...)* has 
now been reduced to a single site (but many-time) 
one: (g[zi, z 2 , ...])* = /nj^t-P^t)] ff^ii ^2, • • •]■ Fol- 
lowing ]l2j we have also introduced the short-hands 
D <1 = Uti d <l(t)/V2^\, Dw = Yl^dwt/V^l Dx = 
Y\ t [dxt / V^n] (with similar definitions for Dq, Dw and 
Dx). Note that all the quantities appearing in (|l7]) are 
macroscopic; all the microscopic variables have been in- 
tegrated out. 



IV. THE SADDLE-POINT EQUATIONS 

We can now evaluate (|l7j ) by saddle-point integration, 
in the limit N — > oo. We define Gtt' — —iKu>- Taking 
derivatives with respect to the generating fields and using 
the normalisation Z[0] = 1 then gives (at the physical 
saddle-point) the usual identifications 



i 



and also 
L tt ' 



lim -J- 



d 2 



at^oo n 4^ d6i(i)d9i(t') 



1 = 0. 



(21) 
(22) 

(23) 



Putting (t) = (they are no longer needed) and d{ (t) 
9(t) then simplifies (BQ) to 



fl = dT W(T) In y DgDg p o (g(0)) 

x e *E t 5(*)[?(*+i)-9(*)-flW]-*E tt ' ?(*)£«'?(*') 

x / e - i Ett'[s(t)C , st 's(i')+s(*)* tt '9(t')]\ 2 j (24) 

in which now s(t) = a[q(t), z t \T], and where W(T) de- 
notes the distribution of local noise strengths: 



(25) 



Extremisation of the extensive exponent N[^f + $ + fl] of 
( p7| ) with respect to {C, C, K, K, L, L} gives the saddle- 
point equations 



C tV = (s(i)s(O)* 



dC w 



Kt, 



Gtt' — 

id<f> 
dKZj 



dim, 

d9(t') ' 



L,t, 



dLZ' 



(26) 
(27) 



The effective single-trader averages (. . .)*, generated by 
taking derivatives of (EOI), are defined as 



IfU X\\ ^ m m f /^g (M[{q,s}}f[{q,s}}) : 
Jo I J D q (M[{q,s}\} z 

(28) 

M[{q,s}]=p o (q(0)) e~ l ^«' S W 6 «' S (*') 

x e »'E t 3(0[9(*+i)-?W-e(t)-E t '^'S' a (*')] ) (29) 

Upon elimination of the trio {C, K, L} via ( p7| ) we ob- 
tain exact closed equations for the disorder-averaged 
correlation- and response functions in the N — ► 00 limit: 
equations (|26|), with the effective sin gle trader measure 
(P9|). One recovers the theory of [Q upon putting 
1U(T) = S(T). 

Since the introduction of decision noise into the dy- 
namics has only affected the term ft (24), compared to 
the analysis in jl2| , the simplifications of the term 4> (re- 
flecting the statistical properties of the trading strategies) 
derived in |12| apply unaltered, so that at the physical 
saddle-point we again find 



L = ~ia(l + G)- l D{t + G T )'\ 
K T = -a{l + G)-\ 

d = o, 



(30) 

(31) 
(32) 



where A T denotes the transpose of the matrix A, and the 
entries of the matrix D are given by D tt i = 1 + C U ' ■ We 
now find our effective single trader measure M[{q, s}] of 
(E9I) reducing further to 
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M[{q, S }}=p o (q(0)) 

X jDq e -3 a S«' mi(t+G)- 1 D(t+G T )- 1 ] ttl q(t') 

x e iE t ?(t)[9(t+l)-5W-f(t)+aE t '(l+G0^»(t')]. (33) 

For a given value of T, this describes a stochastic single- 
agent process of the form 

q(t+l) = q(t) - a ^(1 + G)^M?(0.*f 1^1 



t'<t 



+ 6(t)+y/ari(t). 



Causality ensures that (1 + G) tt , 1 = for t' > t. The 
variable z* represents the original single-trader decision 
noise, with (z t ) — and (ztZt>) = Stt', and 77(f) is a 
disorder-generated Gaussian noise with zero mean and 
with temporal correlations given by (rj{t)rj(t')) — E tt /: 



E = (1 + G)" 1 L>(1 + G T )- 1 . 



(35) 



The correlation- and response functions (|2j|,|22j) are the 
dynamic order parameters of the problem, and must be 
solved self-consistently from the closed equations 



C tt ' = {a[q(t),z t \T} a[q(t'), z t ,\T] 
d 



G 



dO(t') 



a[q(t),Zt\T] 



(36) 
(37) 



which, following (p8|), now also involve averaging over the 
distribution of the noise strengths T. Note that M[{q, s}] 
as given by (33) is normalised, i.e. JDq M[{q,s}] = 1, 
so the associated averages reduce to 

(/[{?,*}]>* = fdT W{T) J Dq (M[{q,s}}f[{q,s}}} z . 

(38) 

The calculation in |12[ of the disorder-averaged average 
bid and the volatility matrix (including the single-time 
volatility of = 2 tt ) still hold, and hence 



JV 



lim (A) t = 0, 



lim E w = ^ tt ,. (39) 



V. THE FIRST TIME STEPS 

For the first few time steps one can calculate quite 
easily the order parameters (correlation- and response 
functions) and the volatility, from (|3^) , using the simpli- 
fications which follow from causality such as 



[G n ) w =0 for t'>t- 



(40) 



At t = this immediately allows us to conclude that 
Eoo = Dqq = 2. We now obtain from ( |33| ) the joint 
statistics at times t = 1, given a value for T: 



Ke(i)k(o)) = 

dz Q P(z ] 



e -[g(l)-g(0)-e(0)+o: a[q(0), Zo \T]] 2 /4a 



(41) 



Equation (^) allows us to calculate Cio and Gio, al- 
though the presence of the decision noise induces expres- 
sions which are significantly more difficult to work out 
explicitly than those of the noise- free case in |12|, and 
which will depend on the choice made for a[q, z Tj: 



(34) C w = dT W(T) dzodziP(z )P( Zl ) dq(0) Po (q(0)) 



e -[g(l)-?(0)-e(0)+a a[q(0)MT]] 2 /4 a 

x a[q(0),Zo\T] a[q(l), Zl \T], 



(42) 



G w = J dT W(T) I dz dz 1 P{z )P{z 1 ) I dq(0)p o (q(0)) 
dq(l) 



o -[q(l)-q(0)-6(0)+a a{q(0) ,z \T}] 2 / 4a 



2y/an 

d -a[q(l), Zl \T}. 



(43) 



dq{ 



We can now move to the next time step, again using (|4C|), 
where we need the noise covariances En and Eiq: 



Eio — 1 + Gio — 2Gio, 

E n = 2-2G 10 [l + G i] + 2[G 10 ] 2 . 



(44) 
(45) 



This procedure can in principle be repeated for an arbi- 
trary number of time steps. 

We now specialise to the case where the game is ini- 
tialised in a tabula rasa manner, i.e. p(q(0)) = 5[qa], and 
where we have no perturbation fields, i.e. 9(t) = 0. Now, 
upon also using the symmetry of P(z), we can reduce the 
above results to 



C 
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dT W(T) [dz P(z) [-%= e -k+a] 2 /^ 
o 'J 'J A^/an 

x {a[q,z\T]-a[-q,-z\T]}. (46) 



G, 



dT W(T) [ dz P(z) f 
^-{a[q,z\T]-a[-q,-z\T}}. 



-[q+a] 2 /4a 



(47) 



Inspection of these expressions for large and small a, and 
for the specific choices (||^) reveals the following. For 
a — > oo one finds 



lim Gi 



0. 



lim En = 2, 

a — >oo 



(48) 



for both noise types. The order parameters Gio and E, 
in contrast, are sensitive to the type of noise chosen. For 
additive noise of the form M) one has 



lim Gio = -1, 



lim Eio = 0, 



(49) 
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whereas for multiplicative noise (||) one has 

lim Cio = - / dT W(T)X(T), (50) 

poo 

lim Eio = 1 - / dT W(T)A(T). (51) 

In both cases the negativity of Cio shows that the tabula- 
rasa initialised system immediately enters an oscillation, 
with the 9i(l) on average having opposite sign to the 
corresponding qi(0). Initially, additive noise is found not 
to play a role, and the effective disorder-generated noise 
components r)(t) decorrelate, compared with the deter- 
ministic case of [0. Multiplicative noise, on the other 
hand, is seen to retain an impact, even for short times 
and large a, and to cause a reduction of the oscillation 
amplitude. 

Now we turn to small a, where we make the choice 
P{z) = (2n)~2e~ z / 2 in order to work out integrals ex- 
plicitly. For additive noise ffl) we find 



Cio — — 



V2 



dT W(T) T- 1 +0{ai), (52) 

In i-oo 

do = ^= / dT W{T) T- 1 + 0(a*) (53) 
V 71 " Jo 



V 71 " Jo 

V2 ' 00 



(provided the above integrals over T exist; if they do not, 
we revert back to the leading orders of the T = case [Jl2) , 
i.e. Cio = O{y/o) and do = 0(l/y/a)). Combination 
with the expressions ([44 45 ) shows that in leading order 



V(l) = {\- GioMO) + w + 



(54) 



in which w is a zero-average Gaussian variable, indepen- 
dent of r/(0), with variance (w 2 ) =3/2. Hence we find 
from the effective single spin equation (pil): 



g(l) = »?(0)+O(o) 



9(2) 



(--GioMO) + ^ 



0(a). 



(55) 
(56) 



We observe, as in |l2|j , that for small a and additive 
decision noise the first two time steps are driven pre- 
dominantly by the disorder-generated noise component in 
(|34|). However, whether this noise component starts oscil- 
lating in sign is, in the case of decision noise, crucially de- 
pendent on the distribution of temperatures; only when 
JdT W(T) T -1 is sufficiently large should we expect the 
system to enter the high volatility state. For multiplica- 
tive noise, on the other hand, we arrive for small a at the 
leading orders 



Cio 
Cio 



dT W(T)\(T) +0( q t), (57) 

O 

dT W(T)X{T)+0(^) + ... (58) 



Here the oscillation is much stronger (provided we do 
not scale the temperatures with a). Combination with 
the expressions (44 4^) shows that in leading order the 
disorder-generated noise not only drives the oscillation, 
but is also being amplified by a factor of order a -1 / 2 : 



-Gi 7?(0) + O(a 



(59) 



The effective single trader equation subsequently gives: 
g(l)=VS» 7 (0) + O(a) 1 (60) 
q(2) = -A r dT W{T)\{T) + 0(^). (61) 



Thus, for small a and tabula rasa initialisation^] additive 
decision noise has the most drastic effect on the dynam- 
ics, changing the leading order of the relevant observables 
by a factor yja (in contrast to multiplicative noise). 



VI. STATIONARY STATE FOR a > a c (W(T)) 

If the game has reached a time-translation invariant 
stationary state without long-term memory, then Gtv — 
G(t - f ), C u < = C(t - f ) and £«, = E(i - t 1 ). In this 
section we assume that the stationary state is one without 
anomalous response, i.e. linv—joo X)t< r C(i) = k exists. 
The lower limit of such behaviour in a defines a c (W (T)) . 

In a stationary state one generally finds agents who 
change strategy frequently, but also agents who are con- 
sistently in the minority group. For the latter 'frozen' 
agents, the values of qi will grow linearly in time. 
We follow IQ and separate the two groups by in- 
troducing q~i\t) — qi(t)/t; frozen agents will be those 
for whom lim^oo qi(t) =/= 0, and the quantity (f> — 
lim e ^ limt_ >00 (^[|g(t)| — e])* gives the fraction of 'frozen' 
agents in the original iV-agent system, for A 7 — > oo. 
Transformation of the process (34) gives, for a given T: 



q T (t) = ~q T (l) + YJ2 r >( t ') 



t'<t 



TE 52(t + GU,a[q T (t"),z t „\T]. (62) 



t'<t t"<t> 



We now define qr = lim^oo qrii) (assuming this limit 
exists) and take the limit t — > oo in (B^), giving 



q T 



(63) 



with the time averages mr = lim r ^oo i J2t<r a [lt, %t\T] 
and rj = limr—Kx, - ^2 t<T flit). The variance of rj follows 
from pf; 



1 Note that the small a expansions in this section are made 
for fixed W(T); the observed behaviour is likely to be different 
when W(T) is allowed to scale with a. 
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tf) = (l + k)- 2 {l+ lim ±J2J2 C ^ 



t<T V<T' 



= [l + (m T >*]/(l + fc) s 



(64) 



Note that (my)* = lim T ^oo t" 1 J^ t<T C(i) = c. 

The integrated response (or static susceptibility) k — 
lim T ^oo J2t<r ^(*) ^ s a ^ so calculated along the lines 
of pj]. One writes the response function as G u > = 
a~z(d <j{q(t) 7 z t \T]/d?](t'))±. Integration by parts in this 
expression generates 

(d a[q(t),z t \T}/dr,(t')U =^t'l'M<l(t)^t\T}r,(t'')} ir , 

t" 

(65) 

and hence 

V^E^(*')^(*"))^ t = Hq(t),z t \T] „(0>*. (66) 
t" 

Averaging over the two times t and t' now gives in a 
stationary state without anomalous response: 



(67) 



Inserting the variance (r/ 2 ), as given in (Q), then gives 
the general relation 



(r)m T )± = 



AVa(l + c) 
(1 + fc) 2 ' 



(68) 



A. Additive Decision Noise 

In the case of additive decision noise ([|) we have 
a[q, z\T] = sgn[<? + zT\. The effective agent is frozen if 
q ^ 0, in which case = sgn[5r]. This solves equation 
(gf) if and only if |ry| > ^5/(1 + jfe). If |r/| < V«/(l + *), 
on the other hand, the agent is not frozen; now qr — 
and m,T = (1 + fc) 77/1/0?. As a result, we can calculate 
c = (m T )* and the fraction </> = — \fa/{l + fc)]) = 

1 — erfK/ a/2(l + c)] of frozen agents exactly as in in the 
case [|12| without decision noise, giving the deterministic 
(i.e. W[T) = S(T)) result 



c=l-(l-i^)erf 



a 



2(1 + c) 



'1 + c c 
2J- e ^f 1 ^. 



2na 



(69) 



We use 
as in [112 



6q ) and calculate the covariance (^m.^)* exactly 
The final result is 



1 



erf[ 



2(l+c)J 



1. 



(70) 



with the value of c to be determined by solving Eqn. ( 69 ) . 
We find exactly the same transition point a c as 0.33740, 




FIG. 1. The persistent correlation c as a function of 
a = p/N, for multiplicative noise with W(T) = 5[T - T] and 
different choices of the noise strength (T = 0, 1, 2 from top 
to bottom). Connected markers: individual simulation runs, 
with pN = aN 2 = 10 6 and homogeneous initial conditions 
where qi(0) — q(0) (circles: q(0) — 0, squares: q(0) — 10) 
and in excess of 1000 iteration steps. Thick solid curves for 
a > a c (W (T)): analytical predictions for homogeneous mul- 
tiplicative decision noise. For a < a c (W(T)), where they 
should no longer be correct, they have been continued as thick 
dashed lines. For additive decision noise our theory predicts 
independence of T for a > a c (W(T)), i.e. c as given by the 
T = curve of multiplicative noise. 

signaling the divergence of the integrated response k, as 
was found in the noise-free case. 

Numerical simulations of the (batch) dynamics of 
the present model (which we will not present here, for 
brevity) confirm quite convincingly that, upon measur- 
ing objects such as c or 0, in the case of additive deci- 
sion noise one indeed exactly recovers the graphs of jl2) , 
without any dependence on the noise parameters. This, 
however, will turn out to be quite different in the case of 
multiplicative noise. 



B. Homogeneous Multiplicative Decision Noise 

Next we turn to the case of multiplicative noise 
at first with the simplest distribution W(T) = S[T - T], 
where a[q, z\T] = sgn[q] sgn[l +Tz], and where tot = 
linv^oo r _1 J2t<r s g n ferW] sgn[l + Tz t ]. Since there is 
now only one noise strength in the system, T, we may 
drop the subscripts T for variables such as q(t) or to, 
without danger of confusion. For a frozen agent one now 
finds 



= A(T) sgn[g]. 



(71) 



This solves_equation @ when \rj\ > v / aA(T)/(l + fc). If 
\rj\ < y/a\(T)/(l + fc), on the other hand, the agent is 
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FIG. 2. The asymptotic fraction of frozen agents <f> as 
a function of a = p/N, for multiplicative noise with 
W(T) = S[T — T] and different choices of the noise strength 
(T = 0, 1, 2 from top to bottom). Markers: individual sim- 
ulation runs, with pN — aN 2 = 10 6 and homogeneous initial 
conditions where qi(0) = q(0) (circles: q(0) = 0, squares: 
q(0) = 10) and in excess of 1000 iteration steps. Thick solid 
curves for a > a c (W (T)): analytical predictions for homoge- 
neous multiplicative decision noise. For a < a c (W (T)) , where 
they should no longer be correct, they have been continued 
as thick dashed lines. For additive decision noise our theory 
predicts independence of T, i.e. <f> as given by the T = curve 
of multiplicative noise. 

not frozen; now qx = and m — (1 + k)r)/y/a. We can 
again calculate c = (m 2 )* self-consistently, upon distin- 
guishing between the two possibilities: 



c = X 2 (T)(e 
{l + kf 



(0 



l + k 



1 



n 



(72) 
(73) 



Working out the Gaussian integrals describing the statics 
of r\, with variance (|64|), subsequently gives 



A 2 (T) 



X 2 (T) 



1 + c 



erf 



l aX*(T) 
2(1 + c) 



, 1 + r a\ 2 (T) 



(74) 



From this equation the value of c is solved numerically. 
The fraction (f> of frozen agents is given by 



1 



= 1 — erf 



' cvA 2 (T) 
2(1 + c) 



(75) 



We calculate the remaining object (77m) * in (|6^) by again 
distinguishing between frozen and non-frozen agents and 



FIG. 3. Phase diagram in the (a, 1— A(T)) plane for homo- 
geneous multiplicative noise, i.e. W(T) = S[T — T\. The solid 
line separates a non-ergodic phase with anomalous response 
(left) from an ergodic one without anomalous response (right). 
For additive noise our theory predicts the T-independent tran- 
sition given by the dashed line. 

by using the two identities m = A(T)sgn[?7] (for frozen 
agents) and m = rj(l + k)/yfa (for fickle ones), both of 
which follow from (p3[), giving 



(r,m)+ = X(T)(d 




Insertion into (pq), together with (|6J), then gives the 
desired expression for the integrated response: 

1 

~k ,„.n / aX 2 (T) 



erf[ 



-1, 



(76) 



2(1- 



with the value of c to be determined by solving Eqn. 
Equivalently, using (fa) we find, as in the T = casellz 



k = 



1 



1 



(77) 



The integrated response k is positive and finite, and 
our solution exact, for a > a c (W{T)). At a c (W(T)) 
one finds that k diverges; this transition is, as for T = 
0, found to happen when the fraction of fickle agents 
equals a 0. Finally, according to ( f74|]7"rj| ) we can write 
a c (W(T)) as a c (W(T)) = erf [a;], where x is the solution 
of the transcendental equation 



A 2 (T) |er%] - 1 



1 



1. 



(78) 
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Equivalently, we can write our transition line explicitly 
in terms of the inverse error function as 



erf" 



A(T C ) 



erf m > c ]0F 



- 1 



(79) 



where A(T) G [0,1], see (g). 

In figures [l] and || we show the solution of equation 
( f74| ) and the corresponding fraction of frozen agents as 
functions of a, together with the values for c and <f> as ob- 
tained by carrying out numerical simulations of the batch 
minority game (j8|) with homogeneous multiplicative de- 
cision noise. The two figures for c and <j> both show ex- 
cellent agreement between theory and experiment above 
a c (W(T)). One observes that, in addition to a reduction 
in the persistent correlation, another effect of the intro- 
duction of multiplicative decision noise is an overall in- 
crease in the fraction of frozen agents. This is consistent 
with our solution of the first few iteration steps, where 
introducing decision noise had the effect of dampening 
the oscillations. In figure || we show the system's phase 
diagrams for W(T) = S[T — T], defined by the transition 
line, where k = oo. This line is given by the solution 
of equation ([79]) in the case of multiplicative noise, and 
by a c (W(T)) w 0.33740 (i.e. the value corresponding to 
A(0) = 1) for additive noise. Below a c (W(T)) our simula- 
tions show, as has been observed and reported earlier for 
the deterministic case, that in the anomalous response re- 
gion the stationary state reached by the system depends 
critically on the initial conditions. For small values of the 
|gi(0)| (i.e. weak initial strategy preferences) the system 
enters a high-volatility state with low c and </>, whereas 
for large values of the |(?i(0)| (i.e. strong initial strategy 
preferences) the system enters a low- volatility state with 
large c and <fi. 



C. Inhomogeneous Multiplicative Decision Noise 

Finally we turn to the more complicated situation of 
multiplicative noise (||) with arbitrary distributions. For 
a frozen agent and for a given value of T one has 



ttit = A(T) sgn[q] 



(80) 

As before, this solves equation do3| ) if > ^/aX(T) / (1 + 
k), whereas for \i]\ < v / aA(T)/(l + k) the agent is fickle, 
i.e. qj — and = (1 + k)rj/^/a. According to 
( ^6| , ^7|) , the calculation of persistent order parameters 
will now also involve averaging over the noise distribu- 
tion. Since the macroscopic dynamics turns out to de- 
pend on T only via A(T), it will be advantageous to define 
w{\) = J^dT W(T)8[X - A(T)], or 



w(X) 



dT W(T) 6 



X- 



dz P{z) sgn[l+Tz] 



(81) 




FIG. 4. The persistent correlation c as a func- 
tion of a = p/N, for multiplicative noise with 
W(T') = eS[T' - T] + (1 - e)5[T'], for T = 1 and differ- 
ent choices of the width (e = 0, 0.5, 1 from top to bottom). 
Markers: individual simulation runs, with pN = aN 2 = 10 6 
and homogeneous initial conditions where qi(0) = q(0) (cir- 
cles: q(0) — 0, squares: q(0) — 10) and in excess of 1000 
iteration steps. Solid curves for a > a c (W(T)): analytical 
predictions. For a < a c (W(T)), where they should no longer 
be correct, they have been continued as dashed lines. 

Here A € [0, 1], with A = reflecting T — > oo contribu- 
tions and A = 1 reflecting T — > ones. Now we may 
write 



dX w(X) | A 
(1 + k) 2 



r'/l 



\faX 



1 



(0 



dX w(X) { A 2 



\faX 
_l + k 

2A 



1 



2na 



■e 2 (!+c) 



erf 



vA 2 



2(1 + c) 



(82) 



From this equation the value of c is solved numerically. 
The fraction 4> of frozen agents is given by 



/ dX w{X) erf 
Jo 



aX 2 



2(1 



(83) 



We calculate the remaining object (t?TOt)* hi (|6J 
by again distinguishing between frozen and non-frozen 
agents and by using the two identities % = A(T)sgn[?7] 
(for frozen agents) and mj- = t](1 + k)/^/a (for the non- 
frozen ones), both of which follow from (p3), giving 



(rjinj 



1 



{l + k)^J 



dX w(X) erf 



»:A 2 



2(1 + c) 
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Insertion into (|68|), together with (64), then gives the 
desired expression for the integrated response: 



/> W (A)erf[y^g 



1. 



(84) 



with the value of c to be determined by solving Eqn. ( 82 ) . 
Using ( |S3| ) this can again be written in the familiar form 
((77]), which suggests that the k — 00 transition is of a 
geometrical nature. 

Unless we revert back to uniform noise levels, a trans- 
formation like a c (W(T)) = erf[a;] will now no longer be 
helpful; to find the location of the phase transition one 
has to solve d82j), together with the condition k = 00. 
Upon putting — a/2(l + c) one can, however, com- 
pactify these two coupled equations to 



(85) 



1 = ^ dX w(X)X 2 |er%A] - 1 + j , 

a = [ dX w{X)er{[yX]. (86) 
Jo 



We will finally work out our equations describing the 
system with inhomogeneous multiplicative decision noise 
explicitly for the following simple bi-modal distribution 



W(T') = e S[T' - T] + (1 - e)S[T'}, 



(87) 



with e € [0, 1]. For e = 1 we revert back to the homo- 
geneous case studied earlier in this section; for e = we 
return to the model of |fL2| . Here we have 



■;(A) = eS[X - A(T)] + (1 - e)S[X - 1], 



with the function A(T) as defined in (^|). The general 
equations (82 8^) from which to solve c and <p reduce to 



2(l + c) 



A 2 (T)- — 
a 



erf 



laX 2 (T) 
2(1 + c) 



He 



1 - 



1+c 



erf 



2(1 + c) 



(89) 




FIG. 5. The asymptotic fraction of frozen agents <J> as 
a function of a = p/N, for multiplicative noise with 
W(T') = eS[T' - T] + (1 - e)S[T'], for T = 1 and differ- 
ent choices of the width (e = 0, 0.5, 1 from bottom to top). 
Markers: individual simulation runs, with pN = aN 2 = 10 6 
and homogeneous initial conditions where qi(0) = q(0) (cir- 
cles: q(0) — 0, squares: q(0) — 10) and in excess of 1000 
iteration steps. Solid curves for a > a c (W(T)): analytical 
predictions. For a < a c (W(T)), where they should no longer 
be correct, they have been continued as dashed lines. 



l = e A 2 (T)<^erf[ 2 /A(T)]-l + 



e -V 2 X 2 (T) I 



+ (l-e)|erf[y]-l + 
a = e erf[yA(T)] + (1 - e)er%]. 



(91) 
(92) 



Note that for T — > our transition line equations reduce 
once more to those of the noise-free derived in 

|l2| , giving a c ~ 0.33740. For T — > 00, in contrast, we 
find a strong dependence on e (the fraction of traders 
who experience decision noise). In particular, there is a 
qualitative difference between e < 1 and e = 1 (where 
one of the two noise levels in the system becomes zero). 

For e = 1 we return to the case of uniform decision 
noise, and equations ( |9l| , |92] ) dictate that the transition 
line obeys a — > as T — > 00. For e < 1 (i.e. a nonzero 
fraction of the traders take decisions deterministically), 
on the other hand, we find for T — > 00 the equations 
@H) (which will now have a solution with finite y) 
reducing to 



= 1 — e erf 



f aA 2 (T) 
2(1 + c) 



- (1 - e)erf 



a 



2(1 + c) 



(90) 



Similarly, the two coupled equations (|85|J8^) which define 
the phase transition reduce to 



1 = (1 - e) |er%] - 1 

a=(l- e)er%]. 
Equivalently: 



2-e-a 
1 -e 



erf 11 



1-e 



(93) 
(94) 

(95) 
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FIG. 6. The phase diagram for multiplicative noise with 
W(T') = eS[T' - T] + (1 - e)5[T'] and Gaussian dis- 
tributed z, shown in the (a, T) plane for different values of e 
(e G {0, 0.2, 0.4, 0.6, 0.8, 1}, from right to left). For each value 
of e, the solid line separates a non-ergodic phase with anoma- 
lous response (left) from an ergodic one without anomalous 
response (right). For additive noise our theory predicts the 
T-independent transition given by the vertical line (i.e. the 
e = curve). 

The solution of this equation defines the point a c (e, T — 
oo), which obeys a c (e < 1,T = oo) > and a c (l,T = 
oo) = 0. 

In figures 1 and ^| we show the (numerical) solution 
of equation (89|) for the persistent correlation c, and the 
corresponding value for the fraction 6 of frozen agents, as 
given by (|90|), as functions of a and for different choices 
of the parameters {T, e}, together with the corresponding 
values for c and 6 as obtained by carrying out numerical 
simulations. Here we have chosen Gaussian distributed 
Zj(£),i.e. A(T) = crf[l/7\/2]. As before, one observes ex- 
cellent agreement between theory and experiment above 
a c , and a strong dependence on initial conditions below 
a c . Finally, in figure^ we show, in the (a, T) plane, the 
system's phase diagram as defined by the k = oo tran- 
sition line, obtained by solving numerically the coupled 
equations (91 ]9^), for different values of e. 



VII. 



STATIONARY VOLATILITY FOR 

a > a C (W(T)) 



As in the noise-free case [Q , one finds that the volatil- 
ity matrix (1^), which is to be calculated from expressions 
( pq ) and which in a stationary state is time-translation- 
invariant S tt / = S(t — t), generally involves both long- 
term and short-term fluctuations. Hence even the ordi- 
nary single-time stationary volatility a 2 — 3(0) cannot 
be expressed in terms of the persistent order parame- 
ter c (or its relatives k and <f>). Upon separating in the 



functions C and G the persistent from the non-persistent 
terms, i.e. C(t) = c + C(t) and G(t) = G(t) (there is no 
persistent response for a > a c ), we find, as in [Q: 



2(1 + k) 2 



1 



U<T ft" 



G)- u l,C t , t „{t + G 



T^-l 
t"u- 



(96) 



Obtaining an exact expression for a 2 would require 
solving our coupled saddle-point equations ( |36|]3lj ) for 
Ctt> and Gu> for large times but finite temporal sep- 
arations t — t' , hence in practice one has to re- 
sort to approximations. The approximation chosen in 
for instance, is in our language equivalent to 
substituting (a[qi(t), Zi(t)\T]a[qj(t), Zj(t)\T]} — > S i3 + 



(1^% ) (a [ Qi (t) , Zl [t)\T] ) (a[ qj (t) , Zj (t)\T] [ 



Here we will 



generalise to the case of decision noise the (at least for 
the batch MG) slightly more accurate approximation pro- 
posed in Jl2|. We will abbreviate the double averages 
/ dT W(T)(. . .) as ((. . .)). In order to find the volatility 
we separate the correlations at stationarity in a 'frozen' 
and a 'fickle' contribution: 

C(t-t')=^((a[q(t),z t \T}a[q(t'),z t ,\T])) {l (97) 
+ (1 - 4>){{a[q(t),Zt\T]cr[q{t'),z v |T]» fi , (98) 

which gives, using C(t — t') = C(t — t') — c, and upon 
rewriting the 'fickle' contribution to the volatility: 

1 



2(1 + A;) 2 
1-6 



lim 

r — too 



2t 



lim 



2r ^ ^ 

U<T tt' 



t 

(1 + (7)^(1 + G T )"i 



x((a[g(t), 2t |T]a[g(0,^|r])) fr . 



))f 



(99) 



The approximation of [|12j consists of retaining in the 
contribution from 'fickle' agents only the instantaneous 
u = t terms, the rationale being that the u ^ t ones 
represent in the original single-trader equation a retarded 
self-interaction, which is assumed to be significant only 
for 'frozen' agents. Hence we obtain 



a 2 = 



1 



2{l + k) 2 

U<T tt' 

x((a[q(t),z t \T]a[q(t'),z t ,\T])} fl . 



(100) 



Note that, according to ( |8^ , |84| ), the integrated response 
k can be expressed in terms of the order parameter 6 as 
k = (l-6)/(a-l + 6). 

At this stage we again have to distinguish between ad- 
ditive noise and multiplicative noise, in order to work 
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FIG. 7. The asymptotic volatility a as a function of a, 
for multiplicative noise with W(T) = S[T — T] and different 
choices of the noise strength (T = 0, 1, 2 from bottom to 
top in q > a c regime). Markers: individual simulation runs, 
with pN — aN 2 = 10 6 and homogeneous initial conditions 
where qi(0) = q(0) (circles: q(0) = 0, squares: q(0) — 10) 
and in excess of 1000 iteration steps. Thick solid curves for 
a > a c (W (T)): analytical predictions for homogeneous mul- 
tiplicative decision noise. For a < a c (W(T)), where they 
should no longer be correct, they have been continued as thick 
dashed lines. For additive decision noise our theory predicts 
independence of T, i.e. a as given by the T = curve of 
multiplicative noise. 

out the remaining averages. For additive noise one simply 
finds 

((a[ q (t),z t \T}a[ q (t'),z t ,\T})) h . = «<r[g(i)M«(f = 1, 

and hence we recover the expression describing the noise- 
free case in fn2|: 



1 



1 



2(1 + fc) 2 



(101) 



Since the order parameters <f> and k are, for additive noise, 
independent of the noise distribution, the same is true for 
the volatility. This independence of the noise parameters, 
at least for a > a c (in line with |l(],[ll|]), again finds 
confirmation in numerical simulations (that is, within the 
limits imposed by our approximation; one does observe 
some weak effect, which could either be due to excessive 
relation times or due to the retarded self-interaction of 



'fickle' traders, which we neglected in deriving ( 101 )) 



The more interesting case, as before, is that of multi- 
plicative noise. Here we have 

({a[ q (t),z t \T}aW),z t ,\T}}) ir = {{\ 2 (T))) ir 

+fe,[l-«A 2 (T))) fr ]. (102) 

Hence the approximation (|100|) reduces to 



FIG. 8. The asymptotic volatility a as a function of a, for 
multiplicative noise with W(T') = eS[T' - T] + (1 - e)6[T'], 
for T = 1 and different choices of the width (e = 0, 0.5, 1 
from bottom to top in the a > a c regime). Markers: indi- 
vidual simulation runs, with pN — aN 2 — 10 6 and homoge- 
neous initial conditions where qi(0) = q(0) (circles: q(0) = 0, 
squares: q(0) = 10) and in excess of 1000 iteration steps. 
Solid curves for a > a c (W (T)): analytical predictions. For 
a < a c (W (T)) , where they should no longer be correct, they 
have been continued as dashed lines. 



1 + 



1 



2(1 
1 



(!-■ 



+^(1- X )[(1 + G)- 1 (1 



G ) K°)- (103) 



Here we have used time-translation invariance of the sta- 
tionary state, giving [. . ,] tt — > \. ](t — t) = [. . .](0) for the 
relevant matrix elements in ( |l03| ) . The conditional aver- 
age x = ((A 2 (T))) fr , constrained by \r}\ > y/a\(T) / (1+k) 
(which, in the case of multiplicative noise, is the condi- 
tion for an agent to be frozen) and calculated using the 
variance {rj 2 ) = (1 + c)/(l + k) 2 ( |64| ) of the zero-average 
persistent noise term, is given by 

X=«A 2 (T)» fr 



J^dT W(T)X 2 (T)jDz 9 




J™dTW(T)fDz6 




V^A(T)" 





J> w(X)X 2 



1 - erf 



1 - erf I 



__\\/a_ 

\/2(l+e) 



(104) 



We note that only for W(T) = S(T) @, i.e. w(X) = 
8(X — 1), where x = 1, w iU ( |103| ) involve only persistent 
observables. In the presence of decision noise, as in this 
study, one always has x < 1, and additional approxima- 
tions are required to reduce also the last term in Jl03|) 
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further to an expression in terms of persistent order pa- 
rameters only. This is done in detail in the appendix, 
where we show that a reasonable approximation is ob- 
tained by simply putting [(t + G)~ 1 (l + G T )~ 1 ](0) -> 1. 
The end result is the following final approximation for 
the stationary state volatility: 



i + 4>x 



2(1 



■ ki- 
ll) 3 2 V 



+ ^(1-X), (105) 



with x a s given by (104) 



Expression (105), which reverts back to that of ]12| ] 
for T — > and which also reduces correctly to the ran- 
dom trading limit a = 1 for T — ► oo (where 0=1, 
c = k = x = 0), turns out to be a surprisingly accurate 
approximation of the volatility for a > a c (i.e. in its 
regime of validity). This can be observed in Figures Q 
and ||, where we compare the approximate prediction 
( |105| ) to the volatility as observed in numerical simula- 
tions, for both homogeneous multiplicative noise defined 
by W(T) = S[T — T] and for inhomogeneous multiplica- 
tive noise defined by ( |37[|8§| ), respectively. In all cases 
A(T) = crf[l/T\/2] (note: the persistent order parame- 
ters have already been calculated in the previous section). 

The above results emphasize once more the qualitative 
difference between additive and multiplicative noise: in 
contrast to additive noise, the system remains sensitive 
to multiplicative noise even for a > a c . The resulting 
dependence of the volatility on the multiplicative noise 
strength is very similar to that reported in Q for addi- 
tive noise (which was later understood to be caused by 
insufficient equilibration |l^,0). 



VIII. DISCUSSION 

In this paper we have generalised the Thermal Minor- 
ity Game to the case of imhomogeneous agent pop- 
ulations (where the decision noise, which can be either 
additive or multiplicative, is of non- uniform strength). 
We have solved the dynamics of the batch version of this 
model by generalizing the recent application fl^| to the 
Minority Game of the generating functional techniques 
of Jl3| (note that in Jl2| only the fully deterministic case 
was studied). This formalism reduces the ./V-agent dy- 
namics, in the limit N — > oo, to a stochastic process for a 
single 'effective agent', with dynamic equations involving 
coloured noise and a retarded self-interaction. It leads to 
exact closed (but implicit and non-trivial) equations for 
correlation- and response- functions. 

Our theory enables us to (i) obtain an analytical and 
quantitative understanding of previously observed but 
unexplained phenomena (e.g. suppression of the volatil- 
ity by decision noise, even below random, due to damping 
of the 'crowd anti-crowd' oscillations), (ii) derive exact 
phase diagrams, and (iii) calculate macroscopic observ- 
ables (e.g. the fraction of frozen agents and the persistent 



correlations) in ergodic stationary states exactly^. In the 
case of additive decision noise we find a phase diagram 
identical to that of deterministic decision making in the 
onset of and equilibrium properties of the higher a er- 
godic phase, with non-ergodic behaviour at lower a. In 
the case of multiplicative decision noise, in contrast, we 
arrive at phase diagrams with non-trivial decision noise 
dependencies of the phase separation line as well as the 
behaviour of both phases. Here the control parameters 
are the relative number of possible value for the external 
information, a — p/N, and the parameters character- 
izing the noise statistics. In the non-ergodic regime of 
the model (i.e. for sufficiently small a), our closed equa- 
tions in terms of correlation- and response functions are 
still exact, and can be solved in principle iteratively for 
arbitrary times; however, finding the stationary states 
is hard (see e.g. the calculations for the simpler case 
]l2|)P|. Here we have restricted our calculations in the 
non-ergodic regime to the the first few time-steps, find- 
ing noise dependence for both additive and multiplicative 
decision noise. 

In the present paper we have only worked out explic- 
itly two types of choices for the decision noise strengths 
statistics: a delta distribution (i.e. decision noise of uni- 
form strength), and a parametrized class of bi-model dis- 
tributions. Due to the general nature of our solution, 
however, there is no limit to the different types of noise 
statistics we could have studied. This emphasizes once 
more the remarkable potential and appropriateness to 
the Minority Games of the generating functional analy- 
sis methods of |13 . Two natural next steps would be to 



develop the generating functional formalism for the orig- 
inal 'on-line' formulation of the game, where the external 
information is fed to the agents sequentially (this is the 
subject of or to analyze our present (exact) order 

parameter equations further in the non-ergodic region 
a < a c (W(T)). 



2 Although the stationary state equations derived upon as- 
suming ergodicity and absence of long-term memory are no 
longer valid in the non-ergodic regime, Figures 1,2, 4 and 5 
show that for a < a c (W(T)) their predictions regarding the 
persistent observables c and <fi nevertheless give good qualita- 
tive agreement with the results of simulations from a highly 
biased start (for the volatility a, which also involves non- 
persistent order parameters, this is no longer the case). 

3 Note that a recently proposed procedure Jl(J for calculating 
at least the high- volatility stationary state in the non-ergodic 
regime, based on assuming the integrated response function 
(which diverges exactly at the critical point) to remain infinite 
throughout the a < a c region, is not likely to work for the case 
of decision noise. It would, for instance, predict the simple 
relation (f> = 1 — a (i.e. (f> being independent of the noise 
parameters), which is clearly in conflict with the simulation 
experiments presented in this paper. 
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APPENDIX A: APPROXIMATION OF 
NON-PERSISTENT TERMS IN THE 
STATIONARY VOLATILITY 



The term Q = [(1 + G)~ x (l + G T )- 1 ](0) in ( |l03| ) 
which contains contributions of non-persistent order pa 
ramcters, can be written as 



T (ko 



1 



7r 2n \1 + G(u)\ 2 



(Al) 



with the definition G(ui) = S t <5(t)e -<ul : . The simplest 
approximation for G(t), which respects causality and also 
meets the requirement G(i) = fc, is an exponential 
expression of the form G(t > 0) — > fc(l — 7)7*~ 1 (with 
-1 < 7 < 1 and with G(t < 0) = 0). This gives G(u) = 
fc(l - 7)/(e M - 7), and thus 



Q = 



n duj 



2ir 



7 + /c(l-7)| 2 



(A2) 



We will obtain an estimate for 7 by carrying out an ap- 
proximate calculation of the one-step response function 



G(l) 



d 



d0(t) 



a[q(t + l),z t+1 \T] 



(A3) 



We insert (|34| ) , we use the fact that the response of frozen 
agents will be zero, we repeat our previous ansatz that 
fickle agents do not experience a retarded self-interaction, 
and we carry out the average over the decision noise vari- 
able z t . This is followed by carrying out the average over 
r)(t) (which is Gaussian, with variance (r] 2 (t)) = 2a 2 ; we 
assume, within the context of the present approximation, 
the correlations between rj(t) and the persistent noise 77 
not to be important for fickle agents). This gives 



G(l) = J_£ (( A ( T)e -[ g 2 (t)/a+«]/4 CT 2 



2a z 



2a 2 



»fi- (A4) 



In this expression we simply replace \q(t)\ — > (fickle 
agents being described by values of q(t) which oscil- 
late around zero), and we calculate the resid ual average 
((A(T)))g similar to our calculation of (104). Hence we 
arrive at the approximation 



G(l) 



1 - 



(TWITCH 



-a/4a 2 



fid\ iu(A)erf ^ 



(A5) 



On the other hand, according to our ansatz G(t > 0) = 
k(l — 7)7 t_1 we must demand G(l) = k(l — 7), so that 
(|A5|) leads to the following estimate of 7: 



1 - 



f L]dX w(A)Acrf ( ^ 



J Q d\ w(A)erf 



V 2 ( 1+c ) 



(A6) 



Since for a — > 00 we must find a — 1 (random trading), 
and since fc ~ cT Y (|77|), we conclude from ( |A6| ) that 
7 — * 1 for a —> 00. Conversely, as a is lowered, we 
find a dive rgence of /c at finite a c (where also <f> is finite) . 
Hence (A.6) also predicts that 7 — > 1 for a — > a c . We now 
assume that 7 — > 1 will give a sensi ble approximation in 
the whole range a > a c , and use (A2) to arrive at the 
approximate result 



[(l + G)- i (l + G T )- 1 ](0)«l 



(A7) 



The above derivation is clearly far from rigorous, and not 
quite satisfactory; it simply appears the best one can do 
without actually solving the order parameter equations 
for finite time differences in the stationary state. Yet 
( A7 ) turns out to lead to a surprisingly accurate approx- 
imation for the volatility (see the main text). 
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